Tags: large language models* + docker* + llm*

0 bookmark(s) - Sort by: Date ↓ / Title /

  1. This tutorial guides you through installing and using an inference snap, specifically Qwen 2.5 VL, a multi-modal large language model. It covers installation, status checks, basic chat, and configuring Open WebUI for image-based prompts.
  2. Learn to deploy your own local LLM service using Docker containers for maximum security and control, whether you're running on CPU, NVIDIA GPU or AMD GPU.
  3. This article details significant security vulnerabilities found in the Model Context Protocol (MCP) ecosystem, a standardized interface for AI agents. It outlines six critical attack vectors – OAuth vulnerabilities, command injection, unrestricted network access, file system exposure, tool poisoning, and secret exposure – and explains how Docker MCP Toolkit provides enterprise-grade protection against these threats.
  4. Docker introduces the enhanced MCP Catalog, offering secure discovery and execution of MCP servers, addressing security concerns with containerized solutions, and opening the submission process to the community.
    2025-07-02 Tags: , , , by klotz
  5. This blog details how to use Docker MCP Catalog and Docker MCP Toolkit to easily spin up and manage Model Context Protocol (MCP) servers, connecting them to clients like Claude and Cursor.
    2025-06-23 Tags: , , by klotz
  6. Docker is making it easier for developers to run and test AI Large Language Models (LLMs) on their PCs with the launch of Docker Model Runner, a new beta feature in Docker Desktop 4.40 for Apple silicon-powered Macs. It also integrates the Model Context Protocol (MCP) for streamlined connections between AI agents and data sources.
  7. This article details building a Retrieval-Augmented Generation (RAG) system to assist with research paper tasks, specifically question answering over a PDF document. It covers document loading, splitting, embedding with Sentence Transformers, using ChromaDB as a vector database, and implementing a query interface with LangChain.
  8. Solomon Hykes, creator of Docker and CEO of Dagger, advocates for containerizing AI agents to manage complexity and enhance reusability. At Sourcegraph’s AI Tools Night, he demonstrated building an AI agent and a cURL clone using Dagger's container-based approach, emphasizing the benefits of standardization and debuggability.
  9. Learn how to set up LanguageTool, a private and offline grammar checker, using Docker.
    2025-01-01 Tags: , , , , , by klotz
  10. MarkItDown is a utility for converting various files to Markdown, including PDF, PowerPoint, Word, Excel, Images, Audio, HTML, text-based formats, and ZIP files.

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: tagged with "large language models+docker+llm"

About - Propulsed by SemanticScuttle